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PATTERNED RANDOM MATRICES 
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Abstract. We study the joint convergence of independent copies of several patterned 
matrices in the non-commutative probability setup. In particular, joint convergence holds 
for the well known Wigner, Toeplitz, Hankel, Reverse Circulant and Symmetric Circulant 
matrices. We also study some properties of the limits. In particular, we show that copies of 
Wigner becomes asymptotically free with copies of any of the above other matrices. 



I. Introduction 

A non- commutative probability space is a pair (A,<p), where A is a unital algebra over C 
and if : A — > C is a linear functional such that ip(l) = 1; ip is a state if for a > we have 
ip(a) > and it is tracial if ip(ab) = ip(ba) for all a, b. Elements of A will be called variables. 

The connection between large dimensional random matrices (matrices whose elements are 
random variables) and non-commutative probability spaces is well known and deep. Let 

(X, B, jj) be a probability space. Let L(fj) := f^|L p (X, jj) be the algebra of random variables 

P >i 

with finite moments of all orders. Set 

An := Mat n (L(fi)) (1.1) 

as the space of nxn complex random matrices with entries coming from Then (An, <£j), 

j — 1,2 are non-commutative probability spaces where 

<fi(A) = X - Tr(A) and <p 2 (A) = ^ E[Tr(A)]. (1.2) 

The joint distribution of a family (aj)j 6 / of variables in (A, tp) is the collection of joint 
moments {^(a^ ■ ■ ■ a ik )} , k G N and • • ,ik e /. Let (An, (p n )n>i an d (•A, V 9 ) be non- 
commutative probability spaces and let (a^ n ; i e /) C ^4„ for each n, (a^; i G /) C A Then 
(ai,n; »G/) converges in distribution to (a^; i e /) if all joint moments converge. Equivalently, 
for allpe C[Xi,i G /], 

lim <p n (p({ai,n}iei)) = (fi(p({ai} ieI )). (1.3) 

n 

Convergence of an n x n real symmetric matrix A n with respect to (pi and </? 2 demands 
convergence for each non-negative integer k, respectively of ipi(A^) (almost surely) and 

MA'n). 
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A related notion of convergence is that of the spectral distribution. If the eigenvalues of 
A n are {K}, then the spectral measure of A n is defined as 



1 n 



If as n — y oo, L n converges weakly (almost surely) to a measure fi with distribution function 
F say, then F (or /i) is called the limiting spectral distribution (LSD) of {A n }. 

In his pioneering work, Wigner [12] showed that the GUE (Gaussian Unitary Ensemble, 
Hermitian matrices with i.i.d. complex Gaussian entries with variance 1/n) converges with 
respect to y9 2 to the semi-circular variable s characterized by the limit moments 



The probability law with density \/4 — t 2 l\t\<2 having the above moments is called the semi- 
circle law. This result was extended in many directions for Gaussian Orthogonal Ensemble 
(GOE) and Gaussian Symplectic Ensemble (GSE) and in fact for i.i.d. entries with finite 
second moment. See Bai and Silverstein [2] for detailed treatment. 

Voiculescu [39] introduced the notion of freeness in the context of free groups. It played the 
role of independence in non-commutative probability spaces. Unital subalgebras {Ai}^ C A 
are said to be free if (p(ai ■ ■ ■ a n ) = whenever <p(cij) = 0, aj e Ai j and ij ^ ij + i for all j. 



The notions of freeness and of convergence as in ( 1.3 ) together yield an obvious and natural 
notion of asymptotically free. Voiculescu [ID] showed that if we take k independent Hermitian 
random matrices {Wi tn }i<i<k distributed as GUE then they are asymptotically free. In other 
words, for any polynomial P in k variables, 



E 



-Tr(F(W hn ,...,W k>n )) 
n 



—> t(P(si, . . . , 5^)) as n — >• oo, 



where (s\, . . . , s^) is a collection of free (and semi-circular) variables in some non- commutative 
probability space (A, r). Asymptotic freeness of GUE has been a key feature in the devel- 
opment of free probability and its various applications. Voiculescu [1Q] also showed the 
asymptotic freeness of GUE and diagonal constant matrices. Later, Voiculescu [U] im- 
proved the result to asymptotic freeness of GUE and general n x n deterministic matrices 
{D i n } (having LSD) and satisfying 

sup ||-Dj,n|| < oo for each i, (1.5) 

n 

where || • || denotes the operator norm. This inclusion of constant matrices had important 
implications in the factor theory of von Neumann algebras. Dykema [19] established a similar 
result for a family of independent Wigner matrices (symmetric matrix with i.i.d. real entries 
with uniformly bounded moments) and block-diagonal constant matrices with bounded block 
size. The results were also shown to hold with respect to (fi almost surely (see Hiai and 
Petz [231 [21] for details). For general results on freeness between Wigner and deterministic 
matrices we refer to Anderson et al. [IJ. Various other extensions to Wishart ensembles, 
GOE, GSE are also available. See Capitaine and Casalis [13j, Capitaine and Donati-Martin 
[H], Collins et al. [17], Ryan [32], Schultz P], Voiculescu prf]. 

Freeness is present elsewhere too and one important place is the Haar distributed matrices. 
It is well known that any unitary invariant matrix (in particular GUE) can be written as 
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UDU* where D is a diagonal matrix and U is Haar distributed on the space of unitary ma- 
trices and independent of D. Voiculescu [10] showed that {U, U*} and D are asymptotically 
free. Hiai and Petz [23] showed that the Haar unitaries and general deterministic matrices 



satisfying 1.5 are almost surely asymptotically free. Collins [15] showed that general deter- 



ministic matrices and Haar measure on unitary group are asymptotically free almost surely 
provided the deterministic matrices jointly converge. The case for orthogonal and symplectic 
groups were dealt with in Collins and Sniady [16J. 

One of the important applications of these in random matrix theory was the study of 
the spectrum of W n + P n where W n is a Wigner matrix and P n is another suitable matrix. 
The spectrum of this perturbation has been of interest for a long time (see Fulton [2"Tj). 
Suppose the spectral measure of P n weakly converges to \ip. Then the spectral measure of 
W n + P n converges weakly and almost surely and in expectation to the free convolution of 



fip and the semicircular law of whenever fip has compact support or P n satisfy [L5| These 
results were derived using asymptotic freeness results between deterministic (or random) 
matrices and Wigner matrix. Pastur and Vasilchuk [30] extended these results for unbounded 
perturbations (possibly random) using analytic machinery of Stieltjes transform. It is to be 
noted that this result on the sum does not yield asymptotic freeness between the matrices. 

The special case where P n has finite rank has received considerable amount of interest 
recently. In this case, the limit measure is still the semi-circular law but the behavior at 
the edge has some interesting properties. See Benaych- Georges et al. [4], Capitaine et al. 
PHQ2], Feral and Peche [20], Peche [29]. 

One relevant question is whether this asymptotic freeness persists for some other types 
of matrices. Consider the class of patterned matrices. These are matrices where, along 
with symmetry, some other assumptions are imposed on the structure. Important examples 
are the Toeplitz, Hankel, Symmetric Circulant and Reverse Circulant. The spectrum of 
these matrices were studied in Bose and Sen [6], Bryc et al. [ID] . Hammond and Miller [22J. 
Generally speaking the Stieltjes transform does not seem to be a convenient tool to study 
these matrices due to the strong dependence among the rows and columns. Bose et al. [S] 
showed that under suitable assumptions on the pattern, there is joint convergence of i.i.d. 
copies of a single pattern matrix as dimension goes to infinity. One important consequence 
is that in the limit other kinds of non-free independence may arise. In particular, Symmetric 
Circulants are commutative and Reverse Circulants are asymptotically half independent. As 
yet, no description of independence is available for the Toeplitz and Hankel matrices. 

As a more general goal, we investigate the joint convergence of multiple independent copies 
of these matrices, including the Wigner. Inter alia, we address the asymptotic freeness of 
the Wigner matrices and patterned matrices. 



In Theorem 3.1 , we provide sufficient conditions for joint convergence holds. We deal with 
only real symmetric matrices as the structure of many of these matrices change if one takes 
complex entries. One of the basic necessary assumptions on the pattern matrices is Property 
B, which states that the maximum number of times any entry is repeated in a row remains 
uniformly bounded across all rows as n — > oo. All the above five matrices satisfy Property B. 
Under Property B and some moment assumptions on the entries we show that if a criteria 
(Condition 3.1) holds for one copy each of any subcollection of matrices, then the joint 
convergence holds for multiple copies. This Condition 3.1 is satisfied by all the five matrices. 
We use the method of moments and the so called volume method to prove these results. 
See Bose and Sen pa], Bryc et al. JTU] for the use of volume method for convergence of spectral 
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measure of patterned matrices. As an application of Theorem 3.1, the following holds: if 
P is a symmetric polynomial in any of the two following scaled matrices: Wigner, Toeplitz, 
Hankel, Reverse Circulant and Symmetric Circulant with uniformly bounded entries then 
the spectral measure L n of the matrix P converges to a non-random measure \i on R weakly 
almost surely. 

In Theorem |3.4 we show that any collection of Wigner matrices is free of the other four 
matrices. As already discussed, Wigner and deterministic matrices are asymptotically free. 
By the results of Collins [15] and Collins and Sniady [16] the results are true for general 
deterministic matrices which converge jointly. To the best of our knowledge these results 
directly do not imply the freeness result Theorem 3.4 This is because, the existing results 



need some conditions on the behavior of the trace of the matrices as pointed out in Remark 
3.6 of Collins [15] . The condition in Collins [15] (equation (3.4) therein) was studied in 
Capitaine and Casalis [13] . It was shown that under the technical condition on the random 
matrices (see Condition C and C in Capitaine and Casalis [13]) there is asymptotic freeness 
between Wigner and other random matrices. Although the Theorems of Capitaine and 
Casalis |13j are for GUE, it is expected that the results would be true for real entries or 
GOE. In other available criteria for freeness, condition ( |1.5 ) appears (see Anderson et al. [1] 
and Theorem 22.2.4 of Speicher [HZ])- This is not applicable in our situation as it is known 
from the works of Bose and Sen [B], Bryc et al. JTU] that the spectral norm of Toeplitz, 
Hankel, Reverse Circulant and Symmetric Circulant are unbounded. 

Instead of attempting to check/modify the technical sufficient condition of Capitaine and 
Casalis [13] we extend the volume method to derive Theorem 3.4 This technique is similar 



in spirit to those in Chapter 22 of Nica and Speicher |27j . However, we bypass the detailed 
properties of permutation group and Weingarten functions. It is quite feasible that the tech- 



niques of Collins [15] and Capitaine and Casalis [13] may be extended to prove Theorem 3.4 



Incidentally, if we take the Wigner with complex entries then Theorem 3.4 holds for any 
patterned matrix satisfying Property B and having an LSD. 

The use of random matrix theory and free probability in CDMA (Code Division Multiple 
Access) and MIMO (multiple input and multiple output) systems was shown in many articles. 
See Couillet et al. [18j, Oraby [28], Rashidi Far et al. [HI], Tulino and Verdu [SB]- For a 
MIMO system with n\ transmitter antenna and n 2 receiver antenna, the received signal is 
represented in terms of equation Y n = HA n + B n where A n is an n\- dimensional vector 
depending on n and B n is a noise signal and EI is the channel matrix which generally has a 
block structure as below and Y n is an n 2 dimensional vector. 



d c 2 ... c L ... 
c x c 2 ... C L 

; c x c 2 ... c L 















C x C 2 





c 



L J 



One of the main issues in the study of a MIMO system is the eigenvalue distribution of MM* 
since this is linked to the capacity of the channel. Here {C{\ can be Wigner matrices or 
more general matrices. It may also happen that some of the blocks are Toeplitz or Hankel or 
any other structured matrices. Studying the spectral properties of such matrices boils down 
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to studying the joint convergence of different patterned matrices. The results of this article 
can be used for studying such systems. We refer the readers to the recent article by Male 
[25] which applies similar results for MIMO system. 

Finally we point out that we could not obtain full characterization of the joint limits if 
one of the matrices is not Wigner. It is known that in a complex unital algebra only two 
notions of independence of subalgebras may arise: freeness and classical independence (see 
Speicher |36J). Although Reverse Circulant limit shows half independence, this notion is only 
for variables of an algebra and not for subalgebras (see Bose et al. [9]). For other matrices 
like Toeplitz and Hankel nothing is known yet about the joint convergence. 

In Section [2] we recall definitions of pattern matrices and express the trace in terms of 
circuits and words (equivalently pair-partitions). In Section [3] we state our main results on 
joint convergence of patterned matrices including those mentioned earlier as well as Theo- 
rem 3.3 on the contribution of certain monomials depending on the structure of the matrices. 



We also discuss the properties of the sum of two random matrices in the limit. The final 
Section [| is dedicated to the proofs. 



2. Some basic definitions and notation 

2.1. Patterned matrices, link function, trace formula and words. Patterned matrices 
are defined via the link functions. A link function L is defined as a function L : {1, 2, .., n} 2 — > 
Z>,n > 1. For our purposes d = 1 or 2. Although L depends on n, to avoid complexity of 
notation we suppress the n and consider M 2 as the common domain. We also assume that L 
is symmetric in its arguments, that is, L(i,j) = L(j,i). 

Let {x(i)} and {x(i,j)} be a sequence of real random variables, referred to as the input 
sequence. The sequence of matrices {A n } under consideration will be defined by 

A n = ((ai,j))i<i,j,< n = ((x(L(i,j)))). 

Some important matrices we shall discuss in this article are: 
(W n ) Wigner matrix: L : N 2 — > Z 2 where L(i,j) = (min(«, j), max(i, j)). 
(T n ) Toeplitz matrix: L : N 2 — > Z where L(i,j) = \i — j\. 
(H n ) Hankel matrix: L : N 2 — > Z where L(i,j) =i + j. 

(RC n ) Reverse Circulant: L : N 2 — > Z where L(i,j) = (i + j) mod n. 

(SC n ) Symmetric Circulant: L : N 2 — > Z where L(i,j) = n/2 — \n/2 — \i — 

It is now well known that the limiting spectral distribution (LSD) of the above matrices 
exists. Bose et al. [8] reviewed the results on LSD of the above matrices. For various results 
on Wigner matrices we refer to the excellent exposition by Anderson et al. pQ. 

The L function for all the five matrices defined above satisfy the following property. This 
property was introduced by Bose and Sen |5j and shall be crucial to us. (For any set S, #S 
or IS* | will denote the number of elements in S). 

Property B: We say a link function L satisfies Property B if, 

A(L) = sup sup sup #{l : 1 < I < n, L(k, I) —t} < oo. (2.1) 



In particular, A(L) = 2 for T n , SC n and A(L) = 1 for W n , H n and RC, 
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Consider h different type of patterned matrices where type j has pj independent copies, 
1 < j < h. The different link functions shall be referred to as colors and different independent 
copies of the matrices of any given color shall be referred to as indices. Let {Xf n , 1 < % < pj} 
nxn symmetric patterned matrices with link functions Lj, j — 1, 2, • • ■ , h. Let X\ (Lj(p, q)) 
denote the (p, q)-th entry of X 3 in . We suppress the dependence on n to simplify notation. 
Two natural assumptions on the link function and the input sequence are: 

(Al) All link functions {Lj,j — 1, 2, • • • , h} satisfy Property B, that is, 

max sup sup sup #{g : 1 < q < n, Lj(p, q) — t} < A < oo. 

l<j<h „>i t l<p<n 

(A2) Input sequences {Xl (k) : k e Z or Z 2 } are real random variables independent across 
i, j and k with mean zero and variance 1 and the moments are uniformly bounded, 
that is, 

sup sup sup sup sup E [\Xj(Lj(p, q))\ k ] < Ck < oo. 

1<*<Pj n>l t l<p,9<r* 



We consider {^X 3 in) l <i< Pj}i<j<h as elements of A n given in (1.1) and investigate 
the joint convergence with respect to the normalized tracial states (fx or if 2 (as in (1.2)). 
The sequence of matrices jointly converge if and only if for all monomials q, 



(»(^{*£.,i<i<*,} 



ijl<j<h 



converge to a limit as n — > 00 for either d — 1 or d — 2. For d — 1, the convergence is 
in the almost sure sense. The case of h = 1 and p\ — 1 (a single patterned matrix) was 
dealt in Bose and Sen [6] and h = 1 and p\ > 1 (i.i.d. copies of a single patterned matrix) 
was dealt in Bose et al. [8]. In particular, convergence holds for i.i.d. copies of any one of 
the five patterned matrices. The starting point in showing this was the trace formula. The 
related concepts of circuits, matchings and words will be extended below to multiple copies 
of several matrices. 

Since our primary aim is to show convergence for every monomial, we shall from now on, 
fix an arbitrary monomial q of length k. Then we may write, 



q ~7^{ X lm l < i <Pj}i<j<h 



1 



k/2 



n 



C2M 



(2.2) 



where Z i 



r f 



Xf m for 1 < m < n. 



From (2.2) we get, 

JT n {q) := - Tr 
n 



a 



k/2' 



c fe;*fc 



Yl i Z ci,t 1 ( L c 1 (ji,32))Z C2 ,t 2 (L C2 (j 2 ,j 3 )) ■ ■ ■ Z Ck>tk (L Ck (j k , ji))] 
h>h,— ,jk 



1 



n l+k/2 

tt:{1,- ,k}-+{l, » ,n} i=l 
7r(0)=7r(fc) 



11^(^(^-1)^(0)) 
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,k}-+{l,- ,n} 
7r(0)=7r(fc) 

Also define, 

K = V\jT n \. (2.4) 



Keeping in mind that we seek to show the existence of the limits in (2.3) and (2.4) asn-> oo, 
we now develop some appropriate notions. In particular these help us to show that certain 
terms in these sums are negligible in the limit. 

Any map 7r : {1, • • • ,k} — > {1, • • • ,n} with tt(0) = n(k) will be called a circuit. Its 
dependence on k and n will be suppressed. Observe that Ji^ and involve sums over 
circuits. Any value L c .(7c(i — l),ir(i)) is called an L-value of it. If an L-value is repeated e 
times in 7r then ir is said to have an edge of order e. Due to independence and mean zero of 
the input sequences, 

E[Z„.] = if tt has any edge of order one. (2.5) 

If all L-values appear more than once then we say the circuit is matched and only these 
circuits are relevant due to the above. 

A circuit is said to be color matched if all the L-values are repeated within the same 
color. A circuit is said to be color and index matched if in addition, all the L-values are also 
repeated within the same index. 

Denote the colors and indices present in q by (ci,c 2 , ••• , c*.) and (t 1 ,t 2 ,--- , tfc) respec- 
tively. We can define an equivalence relation on the set of color and index matched circuits, 
extending the ideas of Bose et al. [8] and Bose and Sen [6]. We say tti ~ 7r 2 if and only if 
their matches take place at the same colors and at the same indices. Or, 

c i = c j ,t i =t j and L Ci (vri(i - l),^^)) = L Cj (vri(j - 1),^^')) 

Ci = Cj,U = tj and L Ci (ir 2 (i - l),7T 2 (i))) = L Cj {-K 2 {j - l),7r 2 (j'))- 

An equivalence class can be expressed as a colored and indexed word w: each word is a string 
of letters in alphabetic order of their first occurrence with a subscript and a superscript to 
distinguish the index and the color respectively. The i-th position of w is denoted by w[i]. 
Any i is a vertex and it is generating (or independent) if either i — or w[i] is the position 
of the first occurrence of a letter. By abuse of notation we also use ir(z) to denote a vertex. 
For example, if 

q = X^X^X^X^X^X^X^Xl = Zi iZi 2^2,1^2,1^2,2^2,2^1,2^1,l) 

then a b\a\ is one colored and indexed word corresponding to q. Any colored and 

indexed word uniquely determines the monomial it corresponds to. A colored and indexed 
(matched) word is pair-matched if all its letters appear exactly twice. We shall see later that 



under Property B 1 only such circuits and words survive in the limits of (2.3) and (2.4) 



Now we define some useful subsets of the circuits. For a colored and indexed word w, let 
n C /(w) = {tt : w[i] = w[j) O (ci,U, Lcifrfa - l),7r(i))) = (cj,tj, L Cj (n(j - l),7r(j))}. (2.6) 
Also define 

U* CI {w) = {vr : w[i\ = w[j] ( Cl ,t h L Ci (n(i - 1),tt(z)) = !'>/,,/., (;, (./ - l),7r(j))}. (2.7) 
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Every colored and indexed word has a corresponding non-indexed version which is obtained 
by dropping the indices from the letters (i.e. the subscripts). For example, a\b\c\c\d 2 d 2 t>\a\ 
yields a 1 b 1 c 2 c 2 d 2 d 2 b 1 a 1 . For any monomial q, dropping the indices amounts to replacing, for 
every j, the independent copies X\ by a single X J with link function Lj. In other words it 
corresponds to the case where pj = 1 for 1 < j < h. 

Let ip(q) be the monomial obtained by dropping the indices from q. For example, 

if q = Zi : iZ lt2 Z2,iZ 2 , 1^2,2^2, 2-^i,2^i,i then ijj(q) = ZiZiZ 2 Z 2 Z 2 Z 2 Z 1 Z 1 . 



(2.6) and (2.7) get mapped to the following subsets of non-indexed colored word vJ via ip: 
n cM = {tt : w[i] = w[j] <^> a = Cj and L Ci {n{i - l),7r(i)) = L Cj (n(j - l),7r(j))}, 

n c-( w ) = I 71 " : W W = Mi] °i = c j and L cA TC ( i ~ = L Cj (7r(j - l),7r(j))}. 

Since pair-matched words are going to be crucial, let us define: 

CIW{2) = {w : w is indexed and colored pair-matched corresponding to q} 
CW{2) = {w : w is non- indexed colored pair-matched corresponding to i>{q)}- 

For w G CIW(2), let us consider the word obtained by dropping the indices of w. This 
defines an injective mapping into CW(2) and we continue to denote this mapping by ip. 
For any w G CW(2) and w' G CIW(2), we define (whenever the limits exist), 

p c (w) = lim \U* c (w)\ and p C i(w') = lim \U* CI (w')\. 

3. Main results 

Our first result is on the joint convergence of several patterned random matrices and is 
analogous to Proposition 1 of Bose et al. [8] who considered the case h = 1. 

Theorem 3.1. Let {^X? n , 1 < i < Pj}i<j<h be a sequence of real symmetric patterned 
random matrices satisfying Assumptions (Al) and (A2). Fix a monomial q of length k and 
assume that, for all w G CW{2) 

p c {w) = lim I \U* c (w)\ exists. (3.1) 

n— >-oo n + I 

Then, 

(1) for all w G CIW{2), pci{w) exists and pciiw) = pc{^>{w)), 

(2) we have 

lim fi n (q) = y~] pci{w) = a{q)(say) (3.2) 

n— >oo ' ' 

wdCIW{2) 

with 

I (h)^\\it/2 if k is even and each index appears even number of times 
\a(q)\ < < y k i l >- 1 

I otherwise. 

(3) lim^oo fin^q) = a(q) almost surely. 

As a consequence if (3.1) holds for every q then {^X- n , 1 < i < Pj}i<j<h converges jointly 
in both the states <pi and (p 2 and the limit is independent of the input sequence. 
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Remark 3.1. (i) Theorem 3.1 asserts that if the joint convergence holds for pj = l,j = 
1, 2, • • • , h (that is if condition (3.1 ) holds), then the joint convergence continues to hold for 
Pj > 1. There is no general way of checking (3.1). However, see the next theorem. 

for any fixed monomial q that yields a symmetric 



fii) Under the conditions of Theorem 3.1 



matrix, the corresponding LSD exists. Using truncation arguments, it is possible to prove 
this under the weaker assumption that the input sequence is i.i.d. with second moment finite. 



Theorem 3.2. Suppose Assumption (|A2|) holds, 
and for all w 



Then pc{w) exists for all monomials q 
CW(2), for any two of the following matrices at a time: Wigner, Toeplitz, 



Hankel, Symmetric Circulant and Reverse Circulant. 



Theorem 3.1 and Theorem 3.2| shows that if P is a symmetric polynomial in any of the 
two matrices Wigner, Toeplitz, Hankel, Symmetric Circulant and Reverse Circulant then 
the spectral measure of P converges almost surely. 

In general the value of pc{w) cannot be computed for arbitrary pair-matched word. In 
the two tables, we provide some examples. As seen in the two tables, pc(w) equals one for 



TABLE 1. pc{w) for colored words corresponding to monomials q = q(T,H) 



Monomial 


Word 


pc{w) 


TTHH 


aabb 


1 


THTH 


abab 


2/3 


TTTTHH 


aabbcc 


1 




abbacc 


1 




ababcc 


2/3 


HHHHTT 


aabbcc 


1 




abbacc 


1 




ababcc 





TTHTTH 


aabccb 


1 




abcbac 


1/2 




abcabc 


1/2 


HHTHHT 


aabccb 


1 




abcbac 


1/2 




abcabc 






certain words. We now identify a class of such words. This has ramifications later in the 
study of freeness. 

If for a w G CW(2), sequentially deleting all double letters of the same color each time 
leads to the empty word then we call w a colored Catalan word. 

In the non-colored and non-indexed situation, Bose and Sen [6] established that p(w) = 1 
for the five matrices for all Catalan words w. Banerjee and Bose [3] introduced the following 
condition which guarantees this. 

Consider the following boundedness property of the number of matches between rows 
across all pairs of columns. 

Property P: A link function L satisfies Property P if 

M* = sup sup #{1 <k<n: L(k,i) = L{k,j)} < oo. (3.3) 

n i,j 

Note that the five matrices satisfy Property P. 
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TABLE 2. Pc{w) for colored words corresponding to monomials q = q(H,R) 
and q(H,S) 



Monomial 


Word 


p c (w) 


Monomial 


Word 


p c (w) 


RRHH 


aabb 


1 


SSHH 


aabb 


1 


RHRH 


abab 





SHSH 


abab 


2/3 


R,R,R,RHH 


aabbcc 


1 


SSSSHH 


aabbcc 


1 




abbacc 


1 




abbacc 


1 




ababcc 







ababcc 


1 


HHHHRR 


aabbcc 


1 


HHHHSS 


aabbcc 


1 




abbacc 


1 




abbacc 


1 




ababcc 







ababcc 





HRHRRH 


aabccb 


1 


HHHSHS 


aabcbc 


1/2 




abcbac 







abbcac 


1/2 




abcabc 


2/3 




abcabc 





HHRHHR 


aabccb 


1 


HHSHHS 


aabccb 


1 




abcbac 







abcbac 


1/2 




abcabc 


1/2 




abcabc 






It is not hard to see that colored Catalan words are in one one correspondence with non- 
crossing colored pair-partitions. Thus freeness and semi-circularity may be described for 
our limits in the language of words: if the limit satisfies pc{w) = for all words which 
are not colored Catalan, then the limit is free. In addition, if pc{w) = 1 for all colored 
Catalan words, then the limits are also semicircular, which is precisely what happens for 
Wigner matrices. For the other four matrices, the limit is neither semicircular nor free but 
Pc{ w ) — 1 f° r & 11 colored Catalan words as Theorem 3.3 shows. This extends the main result 



of Banerjee and Bose (3j to multiple copies of colored matrices. 



Theorem 3.3. (i) Suppose X and Y satisfy Assumption (Al) and Assumption (A2). Con- 
sider any monomial in X and Y of length 2k. Then 

\^c( w )\ — nl+k f or an V colored Catalan word w. 
As a consequence, pc{w) > 1 for any colored Catalan word w. 

(ii) Suppose the link functions satisfy Property B and Property P and the input satisfies 
Assumption (A2). Then for any colored Catalan word, pc{w) 



1. 



It is well known that independent Wigner matrices are asymptotically free and also they are 
asymptotically free of any class of deterministic matrices {-Di,n}i<i< P which satisfy (1.5) (see 



Theorem 5.4.5 of Anderson et al. [T]). Moreover, the deterministic matrices can be replaced 
by random matrices {A n } which sup n ||A n || < oo (see Speicher [37]) or which satisfy the 
sufficient condition (Condition C) of Capitaine and Casalis [T3"] . 

These results cannot be used here since the spectral norm of Toeplitz, Hankel, Reverse 
Circulant and Symmetric Circulant are unbounded as n — > oo. Nevertheless, using the 
notions of circuits and words we are able to show freeness in a relatively simple way. 

Theorem 3.4. Suppose {Wi^ n , 1 <i <p, Ai^ n , 1 < i < p} are independent matrices satisfying 



assumptions (A2) where Wi^ n are Wigner matrices and A ijTl are any of Toeplitz, Hankel, 
Symmetric Circulant or Reverse Circulant matrices. Then {Wi^ n , 1 < i < p} and {A i n , 1 < 
i < p} are free in the limit. 
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Remark 3.2. Incidentally, the freeness between GUE and other patterned matrices is much 
easier to establish. Indeed, it can be shown that GUE and any patterned matrices having 



Property B and satisfying (A2), having LSD are asymptotically free. We provide a brief 



proof of this assertion at the end of Section |4} 
3.1. Sum of patterned random matrices. 

Proposition 3.1. Let A and B be two independent patterned matrices satisfying Assump- 
tions (Al) and (A2). Suppose pc{w) exists for every q and every w. Then LSD for ^fS- 



exists in the almost sure sense, is symmetric and does not depend on the underlying distri- 
bution of the input sequences of A and B . Moreover, if either LSD of ^= or LSD of ^= has 

unbounded support then LSD of also has unbounded support. 



Proof. The assumptions imply that LSD for ^= and ^= exists. By Theorem 



3.1 



I A B_\ 
l-Tn' ^/Hi 



converge jointly and hence lim^oo nk j 2+1 E(Ti{A + B) = fi k exists for all k > 0. Now let us 
fix k. Let Qk be the set of monomials such that (A + B) k = J2 q eQ k ( ?(^' Hence 

- Tr (^r) fe = E Tr (^> 5 )) = E 

n Jn n L+K ' z z — ' z — ' 



where /i n (g) is as in Section [2] By (3) of Theorem 3.1, /i n (g) — > a(q), almost surely and 
hence, 

Pk = lim — Tr( — -7^— ) fc = ot(q) almost surely. 



q&Qk 

Using (2) of Theorem |3.1| we have 

^ = E ^ l^||| ! A(L 1 , J L 2 ) fe = 2 2 ^A(L 1; L 2 ) fc . 

Now by using Stirling's formula, /3 2 fc < (Ck) k for some constant C. Hence ^2 k P 2 k^ 2k = oo 
and Carleman's Condition is satisfied implying that the LSD exists. 



To prove symmetry of the limit, let q G Qafe+i- Then from (2) of Theorem 3.1, it follows 
that a(q) = 0. Hence (3 2 k+i = J2qeQ 2 k+i a ^ = ® an< ^ ^ e distribution is symmetric. 

To prove unboundedness, without loss of generality let us assume that LSD Ca of has 
unbounded support. Let us denote by /3 2 fc(^4) the (2/c)th moment of Ca- Since LP norm 
converges to essential supremum as p — > oo it follows that (/3 2 fc(A)) 1 / 2fc — > oo as k — > oo. 
Also, /3 2 fc(A) = a(?2fc) where q 2 k(A, B) = A 2k and g 2/!c e <3 2 fc. Since is non-negative 
for all g, it implies /3 2 A: > /?2fc04)- So lim fc _ Sl00 (/3 2fc ) 1//2fc = oo and hence the LSD of has 
unbounded support. □ 



In particular, all conclusions in Proposition 3.1 hold when A and B are any two of Toeplitz 



Hankel, Reverse Circulant and Symmetric Circulant matrices. It does not seem easy to 
identify the LSD for these sums. Some simulation results are given below. 

When one of the matrix is Wigner, Theorem 3.4| implies that the limit is the free convolu- 



tion of the semicircular law and the corresponding LSD. This result about the sum when one 
of them is Wigner also follows from the results of Pastur and Vasilchuk [30J. It also follows 
from the work of Biane [5] that any free convolution with the semi-circular law is continuous 
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and the density can be expressed in terms of Stieltjes transform of the LSD. Unfortunately, 
the Stieltjes transform of the LSD of the Toeplitz and Hankel are not known. 





Figure 1. (i) (left) ffisto gram plot of empirical distribution of Reverse Circulant+ Sym- 
metric Circulant (n — 500) with entries A^O, 1) (ii) (right) Histogram plot of empirical 
distribution of Reverse Circulant +Hankel (n = 500) with iV(0, 1) entries. 





FIGURE 2. (i) (left) Histogram plot of empirical distribution of Toeplitz+Hankel(n = 
1000) with entries iV(0, 1) (ii) (right) Histogram plot of empirical distribution of 
Toeplitz+Symmetric Circulant (n = 500) with iV(0, 1) entries. 



4. Proofs 

To simplify the notational aspects in all our proofs we restrict ourselves to h = 2. 

'1) We first show that 



4.1. Proof of Theorem 3.1 



U* c (w) = U* CI (w) for all w G CIW(2). 

Let 7r G Hq I (w). As q is fixed, 

ip{w)[i] = 4>(w)[j} => w[i] = w[j] 

=> (ci,t h L^ii - l),7r(i))) = (c,-,t,-,L Cj .(7r(.7 - l),7r(j))) (as n e U* CI (w)). 

This implies L Ct (n(i — l),7r(i)) = L c .(n(j — l),7r(j)). Hence 7r G IIq(iP(w)). 
Now conversely, let 7r G Hq(iP(w)). Then we have 

w[i] = w[j] 
=>ip(w)\i] = ip(w)[j] 



=^L Ci (7r(i-l),7r(i)) 

Z^CLe.Ki-l),^!))) 



L c .(7ra-l),7r0-)) 
Z Cj>tl (L Cj (7r(j-l),7r(j))). 



as w\i\ 



Cj and U 



tj. Hence ir G Tl* CI (w) 



So (4.1) is established. As a consequence 

Pci{w) = lim 



n— >oo n 



-ITT* 
l+fc/2 \ n CI 



»| =Pc(ip(w)). 



(4.1) 



JOINT CONVERGENCE 13 

Hence by (4.1) pci{w) exists for all w G CIW(2) and Pci{w) = pc(4>(w)), proving ([!]). 

t 



(2) Recall that Z w = ]J k j=1 Z Cj ^(L CiJ (7r(j - 1),tt(j)) and using Q and Q 

1 



n 



l+fc/2 



E E E ^ 



to: ui matched ttGUc i (w) 



By using Assumption (A2) 



sup E | I < < oo. 



(4.2) 



(4.3) 



By using often used arguments of Bose and Sen [B] and of Bryc et al. [TU] , for any colored 
and indexed matched word w which is matched but is not pair-matched, 



lim 



n— »oo fl 



l+fc/2 



E E ^ 



< 



K 



l+fc/2 



n 



n jMho. 



(4.4) 



By using (4.4), and the fact that E(Z 7r ) = 1 for every color index pair-matched word (use As- 
sumption ( A2 )), calculating the limit in (4.2 ) reduces to calculating lim nl + fc/2 J2 W - w<=ciw(2) 



n 



ci 



Now consider any w G C7W(2). Observe that any circuit in U^ :i (w) — Hci(w) must have 
an edge of order four. Hence by (4.4), 



lim 

n— too 



n* CI (w) - u CI (w) 

n l+k/2 

As a consequence, since there are finitely many words, 

\Uci(w)\ 



lim fi n (q) = lim V] 



weCIW{2) 
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l+fc/2 



lim \ 

n. — inn ' 4 



n — x z ' ^l+fc/2 

w£CIW(2) 



0. 



: E pc/M = «(<?). 



weC7W(2) 



(4.5) 

To complete the proof of (2), we note that, if either k is odd or some index appears an odd 
number of times in q then for that q, CIW(2) is empty and hence, a(q) =0. If k is even 
and every index appears an even number of times, then we know 



\CIW{2)\ < \CW{2)\ < 



k\ 



(fc/2)!2 fe / 2 ' 



(k/2)\2 k / 2 ' 

Now note that Pci( w ) — A k ^ 2 . Combining all these, we get \a(q)\ < IAA ' 
(3) Now we claim that 

E[ft)-fr(?))1 = 0(n1. 

Observe that, 

4 



2fc+4 



n 



E E(H(Z 7ri - J B(Z 7ri )). 



(4.6) 



T1,T2,T3,T4 J = l 



We say (711,712,713,714) are "jointly matched" if each L-value occurs at least twice across all 
circuits (among same color) and they are said to be "cross matched" if each circuit has at 
least one L* value which occurs in some other circuit. 
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If (tti, 7t 2 , 7t 3 , 7t 4 ) are not jointly matched then without loss of generality there exist some 
L- value in tt\ which does not occur anywhere else. Using E(Z 7ri ) = and independence, 

4 4 

E(;Q(Z^ - E(Z Wj )) = E(Z W1 - E(Z^.)) = 0. (4.7) 

3=1 3=2 

Again, if (tti, 7r 2 , 7r 3 , 7r 4 ) are jointly matched but not cross matched, then without loss of 
generality, assume tt\ is only self matched. Then by independence, 

4 4 

E(n(Z. 3 - E(Z^)) = E[Z W1 - E(Z W1 )] EfQ(Z. 3 - E(Z W ,))] = 0. (4.8) 

3=1 3=2 

So we are left with circuits that are jointly matched and cross matched with respect to q. 
Let Q q be the number of such circuits. 

We claim that Q q = 0(n 2k+2 ). Since the circuits are jointly matched there are at most 2k 
distinct L values among all the four circuits. Let u be the number of distinct L values (of 
a single color) in the circuits. Clearly, for a fixed choice of matches among those distinct L 
values (number of such choices is bounded in n), the number of jointly matched and cross 
matched circuits are 0(n u+A ), so the number of such circuits with u < 2k — 2 is 0(n 2k+2 ). 
Hence it suffices to prove that for a fixed choice of matches among u = 2k — 1 or u = 2k 
distinct L-values occurring across all four circuits, the number of jointly matched and cross 
matched circuits is 0(n 2k+2 ). 

We consider only the case u = 2k — 1 and the other case is dealt in a similar way. Since 
u — 2k — 1, it follows that every L- value occurs exactly twice across all four circuits. Since 
7Ti is not self matched, there is an L value in 7Ti which does not occur anywhere else in -K\. 
We consider the following dynamic construction of (tti, 7r 2 , 7r 3 , 7r 4 ). Since the circuit is cross 
matched, there exists an L value which is assigned to a single edge, say L(7Ti(z* — 1), 7r(i*)). 
First choose one of the n possible values for the initial value 7Ti(0), and continue filling in the 
values of iri(i),i = 1,2, — 1. Then, starting at iti(k) = ^(O), sequentially choose the 
values of 7Ti(A; — 1), 7Ti(A; — 2), 7Ti(z*), thus completing the entire circuit 7Ti. At every stage 
there are n ways to choose a vertex if there is no L-match of the edge being constructed 
with the previously constructed edges, otherwise there are at most A(Li,L 2 ) choices. So 
there are 0(n) choices for at most 2k — 2 distinct L values and hence the number of jointly 
matched and cross matched circuits for u = 2k — 1 is 0(n 2fc_2+4 ), as required. 

By Assumption (|A2[), E[[7. = ^Z^, — E(Z 7rj ))] is uniformly bounded over all (tti, tt 2 , vr 3 , 7r 4 ) 



by K, say. By this and (4.6)-(4.8), it follows that 

^2fc+2 
,2fc+4 



71 

EKSfa) - £n(<7)) 4 ] = 0(— d ) = 0(n- 2 ). (4.9) 



Now using Borel-Cantelli Lemma, JjLn{q) — ju n (g) — > almost surely as n — >■ oo and this 
completes the proof. 



4.2. Proof of Theorem 3.2, Condition (3.1) which needs to be verified (only for even 



degree monomials), crucially depends on the type of the link function and hence we need 
to deal with every example differently. Since we are dealing with only two link functions, 
we simplify the notation. Let X and Y be patterned matrices with link function L\ and L 2 



respectively with independent input sequences satisfying Assumptions (Al) and (A2). Let 



q(X, Y) be any monomial such that both X and Y occur an even number of times in q. Let 
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deg(q) = 2k and let the number of times X and Y occurs in the monomial be k\ and hi 
respectively. Note that we have k = k\ + k 2 . Then it is enough to show that (3.1) holds for 
every pair-matched colored word w of length 2k corresponding to q. 

Let X and Y be any of the two following matrices: Wigner(jy n ), Toeplitz (T„), Hankel(if n ), 
Reverse Circulant (RC n ) and Symmetric Circulant(S'C n ). The case when both X and Y are 
of the same pattern was dealt in Bose et al. [8]. 

Proof of Theorem 3^ is immediate once we establish the following Lemma. 

Lemma 4.1. Let X and Y be any of the matrices, W n ,T n , H n , RC n and SC n , satisfying 
Assumption (A2). Let w G CW{2) corresponding to a monomial q of length 2k. Then there 
exists a (finite) index set I independent of n and {Yl* cl (w) : I G /} C T\* c (w) such that 

(1) n* c (w) = Ui eI n* cl (w), andp c ,i{w) := lim^oo exists for all I G /, 

(2) for I ^ V we have, 

|n* c >)nn^H| = o(n 1+fe ). (4.10) 



Assuming Lemma 4.1, |n^(u>)| = | U; e 7- Ii* cl {w)\ for some finite index set / and 

p c (w) = lim 4pfcl n cHI = E lim 4i^l n c,/HI = E^H" ( 4 - U ) 

lei lei 

The proof of this lemma treats each pair of matrices separately. Since the arguments are 
similar for the different pairs, we do not provide the detailed proof for each case but only a 
selection of the arguments in most cases. 

The set S of all generating vertices of w is split into the three classes {0} U Sx U Sy where 

S x = {i A j : Ci = Cj = X, w[i] = w[j}}, S Y = {i A j : q = cj = Y, w[i] = w[j}}. 

For every z G S — {0}, let jj denote the index such that w[ji\ — w[i]. Let n G Uq(w). 

(i) Toeplitz and Hankel: Let X and Y be respectively the Toeplitz (T) and the Hankel (H) 
matrix. Observe that, 

\n(i - 1) - 7r(z) I = - 1) - ir(ji)\ for all i G S T 

n(i - 1) + 7r(i) = 7r(jj - 1) + ir(ji) for all i G S H - 
Let / be { — 1, l} fcl and I = (li, l kl ) G /. Let IT cl (w) be the subset of Tl* c {w) such that, 

7r(i - 1) - ir(i) = h(iv(Ji - 1) - 7r(ji)) for all i G St, 

7r(z - 1) + tt(z') = - 1) + for all z G S H - 

Now clearly, 

rip(w) = I^Jrip^w) (not a disjoint union). 



Now let us define, 



tt(z') , 1 n — 1, , 

and *7 n = {0, }. (4.12) 



n n n 



Then, 

l n c,/( w )l = #{(^o, -,U2fc) : Vi G C/„ V0 < z < 2fc, - ^ = ^(z^-i - U/J Vz G St 
and +Vi = v k -i + % Vz' G S#, w = w 2 fc}. 
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Let us denote {v^ : i G S} by vs- It can easily be seen from the above equations (other 
than Vq = v 2 k) that each of the {vi : i ^ S} can be written uniquely as an integer linear 
combination L\{vs)- Moreover, L\{vs) only contains {vj : j G S, j < i} with non-zero 
coefficients. Clearly, 

|no,iHI = #{(uo,-,U2fc) : Vi G U n VO < i < 2k, v = v 2k , Vi = L\{v s ) Mi t S}. (4.13) 

Any integer linear combinations of elements of U n is again in U n if and only if it is between 
and 1. Hence, 

|n* C /MI = #K : Vi eU n \/ie S,v = L l 2k (v s ),0 < L\{v s ) < 1 Vi i S}. (4.14) 



From (4.14) it follows that, ^ U *°i+™^ is nothing but the Riemann sum for the function 

1(0 < L\(vs) < l,i S,v = L l 2k (vs)) over [0, l] fc+1 and converges to the integral and hence 

p c ,iH = lim -Un^HI = / J (0 < L\(v s ) <l,i£S,v = L l 2k (v s )) dv s . (4.15) 



[0,1] 



fc+1 



This shows part (1) of Lemma 4.1 For part (2) let / ^ V . Without loss of generality, let 
us assume that, l ix = — 1[ . Let 7r G H* cl {w) [}Tl* cv (w). Then tt(zi — 1) = 7r(ii) and hence 
L l ii _ 1 (vs) = Vi x . It now follows along the lines of the preceding arguments that 

lim -^|n^H f|n*^HI </•••/ = iUN)^ ( 4 - 16 ) 

n— »oo Tl ' ' i i ' J J 



fc+l 



[04] 

•^ii-iC^s) contains {t>j : j £ S, j < i\) and hence {-^i-iC^s) = w i} is a fc-dimensional 
subspace of [0, l] fc+1 and hence has Lebesgue measure 0. 

(ii) Hankel and Reverse Circulant: Let X and Y be Hankel (if) and Reverse Circulant (RC) 
respectively. Then 

tt(z - 1) + 7r(i) = ttO* - 1) + tt(j,) for all 2 G SW, (4.17) 
(7r(i — 1) + 7r(«')) mod n = (7r(jj — 1) + mod n for all i G Src- (4-18) 



Clearly, as all the ir(i) are between 1 and n, relation (4.18) implies (jr(i — 1) + ir(i)) — (7r(j, — 
1) + TfO'i)) = a « n where a, G {0, 1, -1} 

Let a = (ai, dk 2 ) G I — { — 1, 0, l} fc2 . Let Hq^w) be the subset of Hq(w) such that, 

7r(i - 1) + 7r(«) = 7r(ji - 1) + 7r(jj) Vz G Sh and 
(7r(i - 1) + 7r(«)) - (7r(jj - 1) + 7r(ji)) = a*n Vz G SW 

Now clearly, 

nc( u ') = (Jllp )a (w) (a disjoint union). 

a 

Now we get that, 

l n C,a( w )l = #{(^0, -,V2k) ■ V i G U n V0 < % < 2k, Vi-i + Vi = (Vj.-i + v jt ) + a* Vi G SflC 

and + Vi = v k -x + Vz G S H , v = v 2k }. 
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Other than Vq = v 2 h, each {v^ : i ^ S} can be written uniquely as an affine linear combination 
Lliys) + b\ a ^ for some integer of 1 . Moreover, Lf(vs) only contains {vj : j G 5, j < z} with 
non-zero coefficients. Arguing as in the previous case, 

\nc,aW\ = *i v s -VieU n \/ie S,v = L a 2k (v s ) + b^,0 < L«(v s )+b\ a) < m i S}. (4.19) 
This is again a Riemann sum and hence as before, 



pc, a {w) = lim _L|n*, («,)| = f I (o < Lf{vg) + bf ] <l,iiS,vo = L a 2k (v s ) + b 



dv<- 



[0,l] fc 



fe+i 



and the proof of this case is complete. 

(iii) Hankel and Symmetric Circulant: Let X and Y be Hankel (H) and Symmetric Circu- 
lant (SC) respectively. Note that 

ir(i - 1) + 7r(i) = 7r(jj - 1) + it(Ji) Vz G S H and 
n / 2 - | n /2 - \7r(i - 1) - tt(z)|| = n/2 - |n/2 - ^(j, - 1) - tt&JH Vz e S s . 
It can be easily seen from the second equation above that either \ir(i — 1) — n(i)\ = \ir(ji — 
1) — ir(ji) | or \7t(i — 1) — 7r(i) | + \^(ji — 1) — ^(ji) I = n - There are six cases for each Symmetric 
Circulant match and with Vi = ir(i)/n, these are: 



(1) 


Vi- 


-1 


-Vi- v k 


-1 


+ v Ji 


= 


(2) 


Vi- 


-1 


-Vi + v u 


-1 




= 


(3) 


Vi- 


-1 


-Vi + v k 


-1 


~ v k 


= 1 


(4) 


Vir 


-1 


-Vi- v k 


-1 


+ V 3i 


= 1 


(5) 






Vi-i + v k 


-1 


- v k 


= 1 


(6) 


Vi 




Vi-l + v k 




v n-i 


= 1 



Now we can write Hq(w) as the (not disjoint) union of 6 fc2 possible Uq^w) where / denotes the 
combination of cases (l)-(6) above that is satisfied in the ki matches of Symmetric Circulant. 
For each tc G Uq^w), each {vi : i £ S} can be written uniquely as an affine integer combi- 
nation of v s . As in the previous two pairs of matrices in (i) and (ii), lim^oo ^p^\Yl^ t {w)\ 
exists as an integral. 



Now (4.10) can be checked case by case. As a typical case suppose Case 1 and Case 3 
hold. Then n(i — 1) — 7r(z) = n/2 and — Vi = 1/2. Since % is generating and t>j_i is a 
linear combination of {vj : j G S, j < i}, this implies a non-trivial linear relation between 
the independent vertices vs- This, in turn implies that the number of circuits ir satisfying 
the above conditions is o(n 1+k ). 

(iv) Toeplitz and Symmetric Circulant: Let X and Y be Toeplitz (T) and Symmetric Circu- 
lant (SC) respectively. Again note that, 

\ir(i - 1) - 7r(i)| = \n(ji - 1) - ir(ji)\ Mi G S T and 

n /2 - \ n /2 - |tt(z - 1) - 7r(i)|| = n/2 - \n/2 - |tt(j, - 1) - tt^H Vz G S sc - (4.20) 



Now, (4.20) implies either \n(i — 1) — 7r(i)| = \ir(ji — 1) — ff(ji)\ or \n(i — 1) — n(i)\ + \ir(ji — 



!) - *(ji)\ = n - 

There are six cases for each Symmetric Circulant match as in Case (iii) above and two 
cases for each Toeplitz match. 

As before we can write Tl* c (w) as the (not disjoint) union of 2 kl x 6 k2 possible Uq^w) 
where I denotes a combination of cases (l)-(6) for all SC matches (as in Case (iii)) and a 
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combination of cases (l)-(2) for all T matches. As before, for each 7r G Hqi(w), each of 
the {vi : z ^ 5} can be written uniquely as an affine integer combination of v$- As earlier, 
lim^^oo zTf%^c,i( w )\ ex ist s as an integral. 

Now, (4.10) is again checked case by case. Suppose I ^ I 1 and 7r G II^ z (w) P)LT^^(iy). For 
I ^ I', there must be one Toeplitz or Symmetric Circulant match such that two of the possible 
cases in (l)-(2) or in (l)-(6) occur simultaneously. Here we just deal with a typical pair 
Case (1) and Case (2) for the Toeplitz match. Then we have 7i(i — 1) — = and hence 
Vi-i — v i = 0. Since i is generating and t>j_i is a linear combination of {vj : j G S, j < i}, 
this implies there exist a non-trivial relation between the independent vertices v$- This, in 
turn implies that the number of circuits tc satisfying the above conditions in o(n 1+k ). Now 
suppose the Symmetric Circulant match happens for both case (1) and case (2). Then again 
we have t>j = and we can argue as before to conclude that (4.10) holds. 

(v) Toeplitz and Reverse Circulant: Let X and Y be Toeplitz (T) and Reverse Circulant 
(RC) respectively. Note, 

\ir(i - 1) - 7r(i)| = \n(ji - 1) - 7r(j,)| for all i G S T , 

(tt(i — 1) + 7r(z)) mod n = — 1) + mod n for all z G S^c- 

Clearly, as all the 7r(z) are between 1 and n, (7r(z — 1) + 7r(z)) mod n = (vr(jj — 1) + vr(jj)) 
mod n implies (7r(z — 1) + tt(z)) — — 1) + 7r(j»)) = c^n where a, G {0, 1, —1} 

Let the number of Toeplitz and Reverse Circulant matches be k\, and k 2 respectively and 
let us denote S T = {h,i 2 , S RG = {i kl+ i,i kl+2 , z' fel+&2 }. 

Let I = (c,a) = ( Cil ,...,c ifci ,a ifci+1 ,...,a ifci+fc3 ) El — {-l,l} fcl x {-l,0,l} fcs . 

Let Hq^w) be the subset of Hq(w) such that, 

7i(i - 1) - tt(z) = Ci(7r0'i - 1) - TrO'i)) V? G 5 T 
tt(z - 1) + ir(i) = - 1) + ir(ji) + a { n Wi G S RC . 

Now clearly, 

n^H = |Jn^H, 

and translating this in the language of v^s, we get 
\R*c,i( w )\ = #{(^o, -, v 2k ) ■ Vi G U n V0 < i < 2k, + Ui = (u, w + v jt ) + a,i Vi G S^c 
and - = c^v^-i - Vj.) Vi G St, = ^2fc}- 

As in the previous cases, lim^oo ^+1"^ exists. It remains to show that, lim^oo ■ — ^ +k * c ' 1 '^ - 
for I I'. If I = (c, a) ^ V — (c',a'), then either c ^ c' or a ^ a'. If c = c', then 
clearly U^^w) and LT^ z /(iy) are disjoint. Let c 7^ d . Without loss of generality, we assume 
Ci x = —Ci x . Then clearly, for every 7r G I\* cl {w) C\H* cl ,{w) we have f^-i = fj, which gives a 
non-trivial relation between {t> j : j £ 5}. That in turn implies the required limit is 0. 

(vi) Reverse Circulant and Symmetric Circulant: Let X and Y be Reverse Circulant (RC) 
and Symmetric Circulant (SC) respectively. Then 

7r(z — 1) + 7r(z) mod n = 7r(jj — 1) + vr(jj) mod n Vi G Sijc and 
n / 2 - | n /2 - |tt(z - 1) - tt(z)|| = n/2 - |n/2 - |tt0* - 1) - V* e S SC - 

As before, the latter equation implies either \ir(i — 1) — 7r(i)| = |vr(jj — 1) — 7r(j,;)| or \iv(i — 
1) - 7r(i)| + |7r(ji - 1) - 7r(ji)| = n. 
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There are now three cases for each Reverse Circulant match: 

(1) + Vi - Vft-! - Vj. = 0. 

(2) Vi-! +Vi- Vj.-! - Vj. = 1. 

(3) Vi-! +Vi- Vj.-! - Vj. = -1. 

Also, there are six cases for each Symmetric Circulant match as in Case (iii). 

As before we can write Hgiw) as the union of 3 kl x 6 k2 possible Hq^w). Hence arguing 
in a similar manner, lim^oo ^^|n^(u>)| exists as an integral. Now, to check (4.10), case 
by case. Suppose I ^ I' and 7r G U^^ui) f)U* c ^(w). Since / ^ I', there must be one Reverse 
Circulant or Symmetric Circulant match such that two of the possible cases (l)-(3) or (l)-(6) 
(which appear in Case (iii)) occur simultaneously. It is easily seen that such an occurrence 
is impossible for a Reverse Circulant match. We deal with one typical Symmetric Circulant 
match. Suppose then we have both case (1) and case (2). Then again we have Vi = t>j_i and 
as a consequence (4.10) holds. 

(vii) Wigner and Hankel: Let X and Y be Wigner (W) and Hankel (H) respectively. Observe 
that, 

Wi - i)Mi)) = f^* " f*™ C r l\ „ . e , < (4.2D 

I \K\3i)i' K \ji — 1)) (Constraint C2, for all % G o\y)- 

Also, n(i — 1) + ir(i) = ir(ji — 1) + vr(jj) for all i G Sh- So for each Wigner match there are 
two constraints and hence there are 2 kl choices. Let A be a typical choice of fci constraints 
and Uq x (w) be the subset of Uq(w) where the above relations hold. Hence 



Hq(w) = \^J^c,x( w ) ( no ^ a disjoint union) 



Now using equation (4.12) we have, 

\n*C,\( W )\ = #{( V 0,V! . . .V2k) - 0<Vi <l,V = V2k,Vi-! + V i = V jt -!+V jl , % G Sff 
V i-l = Vfr-uVi = V jv (Cl),Vi-! = V jz ,Vi = W ii _i(C2),Z G S W }. 

It can be seen from the above equations that each Vj, j ^ S can be written (not uniquely) 
as a linear combination Lj of elements in vs- Hence as before, 



l n c,A( w )l = - v i = L i ( v s),vo = V2k, for i <£ S,,Vi- t + Vi = Vj.-! +v jt , i G Sh 

Vi-! = Vj.-x,Vi = Vj., (Cl),Vi-! = v jt ,Vi = Vj.-x(C2),i G S w }. 

So the limit of \Tl* c x {w)\/ n 1+k exists and can be expressed as an appropriate Riemann sum. 

Now we show (4.10). Without loss of generality assume Ai is a C\ constraint and A2 is a 
C2 constraint. For any 7r G I\* c Xi {w) f]U.Qs(w) we note that for i G S, 

Wi), <3i ~ 1)) = {<i - 1), tt(z)) = (ttO* " 1), <3i)), 
which implies ir(i) = n(i — 1). Now i is a generating vertex. But ir(i) = ir(i — 1) and hence 
is fixed, having chosen the first i — 1 vertices. This lowers the order by a power of n and 
hence the claim follows. 

(vii) Wigner and other matrices: Since the other cases such as Wigner and Toeplitz and 
Wigner and Reverse Circulant follow by similar and repetitive arguments we refrain from 
presenting a proof for them. 
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4.3. Proof of Theorem 3.3 Let w be a colored word of length 2k for a monomial q = 
q(X, Y). Let w' be obtained from w by a cyclic permutation, that is, there exists / such that 
w'[i] = w[(i + I) mod 2k]. Note that w' is a colored word for the monomial q' obtained from 
q by the same cyclic permutation. We have the following lemma. 

Lemma 4.2. |n^(w)| = and pc(w) = pc(w'). 

Proof of Lemma\l^ Let tt G U.* c (w). Let tt'(i) = 7r((i + /)mod 2k)). Clearly, 7r'(0) = rr'(2k). 
Also 

= w'\j] => L*(tt'(i - l)y(i)) = LV(j - l),7r'(j)) 
where L* is equal to or L 2 according as w'[i] = w'[j] is an X match or a Y match. Hence, 

As w can also be obtained from w' by another cyclic permutation, it follows that the 
map tt — > tt' is a bijection between n£.(u>) and rjp(w'). Hence |n^(w)| = |n^(w')| and 
Pc(w) = pc(w'). □ 

Proof of Theorem 3.3[ (i) We use induction on the length of the word. 

If k = 1 then q = XX or q = YY. The only colored Catalan word is aa (drop superscript 
for ease). In either case, 7r(0) = i, 7r(l) = j, 7r(2) = i is a circuit in Hq(w) fori < i < n, 1 < 
j < n. Hence, |n^(w)| > n 2 and the result is true for k — 1. 

Now let us assume that the claim holds for all monomials q of length less than 2k and 
all Catalan words corresponding to q. By Lemma 4.2 without loss of generality we assume 
that w = aawi where W\ is a Catalan word of length {2k — 2). Now let it' G Uq(wi). For 
fixed j, 1 < j < n, define it by 

tt(0) = 7r'(0) (4.22) 
7r(l)=j (4.23) 
7r(i) = 7r'(j - 2), j > 2. (4.24) 

Clearly tt is a circuit and 7r(0) = tt(2) implies L(tt(0), tt(1)) = L{tt{\),it{2)). Hence it E 
\Hq(w)\ and so, |n^(w)| > n|n^(w 1 )| > n k+1 and hence (i) is proved. 

(ii) We shall now show that pc{w) < 1 for matrices whose link functions satisfy Property B 
and Property P. The proof is same as the proof of Theorem 2 (ii) of Banerjee and Bose [3], 
with appropriate changes to add color and index. We indicate the changes while keeping the 
notation similar to theirs for easy comparison. The proof uses (2k + l)-tuple tt which are 
not necessarily circuit, that is, 7r(0) = Tr{2k) is not assumed. Let w be a colored Catalan 
word. Define 

C'(w) = {tt : w[i] = w\j] =>• d = Cj and L^tt^- l),7r(i)) = L c .(-K(j - l),7r(j))} 
Fi,j(w) = {ff g C(w) : 7r(0) = i, 7r(2/c) = j}, (1 <i,j< n), 7yW = l r i,j(w)|- 
Clearly, |n^(w)| = XT=i 7«,i( u ')- Now consider the following statement S' fe for all > 1: 
S' fc : For any colored Catalan w of length (2k), there exists M fc > such that 



li,j(w) < M k n k 1 for all i ^ j and — ^ 



0(l/n) 



The proof of S'^. easily follows by repeating the steps of the proof of Theorem 2 (ii) of Banerjee 
and Bose [3] and changing the set C(w) there by C'(w) and using Property B and Property 
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P. To avoid repetitive arguments we skip the details. Once the validity of S' fe is asserted, one 
gets pc(w) < 1 and the result now follows using part(i). □ 



4.4. Proof of Theorem 3.4 We need the following development for describing freeness. 
Let S n be the group of permutations of (1, 2, . . . n). 

Definition 4.1. Let A be an algebra. Let ipk : A k — > C k > be multi linear functions. 
For a G S n , let ci, c 2 , . . . c r be the cycles of a. Then define 

V> Q L4i, -42, • • • , A n \ = ip Cl [A u A 2 ,..., A n \i) C2 [A X: A 2 , ■ ■ ■ , A n ] . . . ip Cr [Ai, A 2 ,..., A n \ 

where 



i>c[Ai, A 2 ,..., An] = ip p (A h A i2 . . . A ip ) if c=(ii,i 2 



i 



pi 



Freeness is intimately tied to non-crossing partitions. We describe the relevant portion of 
this relation in brief below. See Theorem 14.4 of Nica and Speicher [27] for more details. Let 
NC 2 {jn) be the set of non-crossing pair-partitions of {1,2,..., m}. A typical pair-partition 
7r will be written in the form {(r, 7r(r)), r = 1,2, ...,m}. For p = (p(l),p(2), . . . ,p(m)) 
integers (also can be referred to as colors), let 

Ndf\m) = {it G NC 2 {m) : p(7r(r)) = p{r) for all r = 1, . . . ,m}. 

Suppose di, d 2 , . . . , d m , Si,s 2 ,... s m are elements in some non- commutative probability space 
(B, ip). Suppose {s\, s 2 , . . . s m } are free and each Si follows the semicircular law. Then the 
collections {si, s 2 , . . . s m } and {di, d 2 , . . . d m } are free if and only if, 

[di,.. .,d rn\ 

ire NC{m) 

= ^ vW^i' • ■ • >d m ], (4.25) 

ttG NC ( 2 p) (m) 

where 7 G S m is the cyclic permutation with one cycle and 7 = (1, 2, . . . , m — 1, m). Here 
k n denotes the free cumulants and k v for a partition 7r is defined along the same lines as 
Definition |4~T1 

We shall also drop the suffix C from pc(w), Hc(w), Uq(w) etc. for simplicity. Fix a 
monomial q of Wigner (W) and any other patterned matrix (A) of length 2k. To prove 
freeness we show that the limiting variables satisfy the relation (4.25). We have already 
remarked that freeness is intimately tied to non-crossing partitions but freeness in the limit 
can also be roughly described in terms of colored words in the following manner. 

(1) If for a colored word the pair-partitions corresponding to the Wigner matrix cross, 
then p(w) = 0. 

(2) If the pair-partition corresponding to the letters of matrix A cross with any pair- 
partition of W then also p(w) = 0. 

For example, p(wiw 2 wiw 2 ai<ii) = and piwidiWidi) = 0. This is essentially the main 
content of Lemma 4.3 given below. 

We will discuss in detail the proof of Theorem 3.4 for p = 1 and indicate how the results 
continue to hold for p > 1. 

We need a few preliminary Lemmata to prove the main result. We first use these Lemmata 
to prove Theorem |3.4| and then provide the proofs of the Lemmata. 
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We now concentrate only on (colored) pair-matched words. For a word w the pair (i,j) 1 < 
% < j < 2k is said to be a match if w[i] = w[j]. A match is said to be a W match or 
an A match according as w[i] = w[j] is Wigner or A letter. 

We define W(ij) to be the word of length j — i + 1 as 

wufi[k] = w[i — 1 + k] for all 1 < k < j — i + 1. 



Let Wfafic be the word of length t + i — j — 1 obtained by removing w^j) from w, that is, 

w[r] if r < i, 

w[r + j — i + 1] if r > i. 



Note that in general these subwords may not be matched. If is aW match, we will call 
a Wigner string of length (j — % + 1). For instance, for the monomial W AAAAWWW , 
it; = abbccadd is a word and abbcca and are Wigner strings of length six and two respec- 
tively. For any word w, we define the following two classes: 



n 



(C2) 



{tt G n*H : (z, j) W match ^ (tt(» - l),7r(i)) = (ir{j),ir(j - 1))}(4.26) 
{tt G n*H : (7r(i - 1), 7T(i)) = (7r(j), 7t(j - 1))}. (4.27) 



Note that the condition appearing above involves C2 constraint defined in (4.21) and 

iW«0= fl n (M)H- ( 4 - 28 ) 

Wmatch 

It is well known that if we have a collection of only Wigner matrices then p(w) ^ if and 
only if all the constraints in the word are C2 constraints. See for example Bose and Sen [B] . 
We need the following crucial extension in the present setup. 

Lemma 4.3. For a colored pair-matched word w of length 2k with p(w) ^ we have: 

(a) Every Wigner string is a colored pair-matched word; 

(b) For any which is a W match we have 



lim 

n — >oo 



\U*(w) - IT 



{id) 



»l 



71 



l+k 



(c) 



lim 



\n*(w) -n 



(£72) 



»l 



71 



l+k 



0. 



0. 



(4.29) 



(4.30) 



Note that (c) and (b) are equivalent by (4.28) and as the number of pairs is finite. 

Lemma 4.4. Suppose X n has LSD and they satisfy Assumption Al and A2, then for any 
I > 1 and integers (hi, k 2 , ■ ■ ■ , h), we have 



E 



n< 

»=i 



Tr( 



71 



» 



i=i 



71 



Tr( 



— y as n oo. 



Assuming the above lemmas we now prove Theorem 3.4 



Proof of Theorem 3.4 ■ We take a single copy of W and A to show the result but for mul- 
tiple copies the proof essentially remains same modulo some notations. Let q be a typical 
monomial, q = WA q W\VA q W . ..fA'W of length 2k, where the g(i)'s may equal 0. So, 
k = m/2 + (q(l) + q(2) + . . . + q(m))/2. From Theorem 3.2, for every such monomial 
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q, ~^t+i Tr(g) converges to say ip(sa q ^ . . . sa 9 ^" 1 ^), where s follows the semicircular law and 
a is the marginal limit of A, and ip is the appropriate functional defined on the space of 
non-commutative polynomial algebra generated by a and s. It is enough to prove that if 
satisfies (4.25). 

Let us expand the expression for 

lim — — E[Ti{WA q{1) WA q{2) . . . W A q{m) )} 



n— ¥00 ft 



lim 



n— >oo 77, 



X+k 



ET-ir 9(1) <?(2) q( m ) 1 /i oi ( 

Hw i(1)j{1) a jim2) w i( 2)j(2)a j(2)m ■ ■ ■ Wi {m ) j{rn) a j{m)i{1) \ (4.31, 



i(l),i(2),...i(m) 
j(l)j(2),...j(m)=l 



lim 



n— >oo 77 



1+fc 



weCW(2) vreiPO) 



lim 



n— >-oo 77 



^ E[X^] (by Lemma |4~3((c) and Assumption flA2])). (4.32) 



™ecw(2) 7ren* C2) («)) 



Colored pair-matched words of length 2k are in bijection with the set of pair-partitions on 
{1,2, . . . ,2k} (denoted by 7 3 2 (2A;)). Now each such word w induces a w a pair-partition of 
{1, 2, . . . m} that is induced by only the Wigner matches i.e (a, b) G u w iff (a, b) is a Wigner 
match. So given any pair-partition a of {1, 2, ... , m}, we denote by [a]w the class of all w 
which induce the partition a. So the sum in ( |4.32[ ) can be written as, 



lim 



n— >oo 77 



m E E E 



(4.33) 



cr£V2(m) w£[cr] w tt&II^ C2 ^(w) 



By C2 constraint imposed on the class ni-^uj), if (r,s) is a IV match then (i(r),j(r)) = 
(j(s),i(s)) (or, equivalently in terms of 7r we have, (n(r — l),7r(r)) = (7r(s),7i"(s — 1))). 

Therefore, we have the following string of equalities. Let tr be the normalized trace. The 
equality in (pi follows from (Oil and gjjjb. The steps in ((435}, gggb and ((4371) follow 



easily from calculations similar to Proposition 22.32 of Nica and Speicher [27]. The last step 
follows from the fact that the number of cycles of o"7 is equal to 1 + m/2 if and only if 



a G NC2(m). The notation tr CT7 is given in Definition 4.1 
1 



lim E[Ti(WA q( - 1) WA q{2) . . . WA q{m) )} 



n— >-oo 77 



lim 



n— »oo 77 



lim 



n— »oo 77 



hi e tn « 

(TeVi{m) i{l),i(2),...i(m) (r,s)e<r 
j(l),i(2),...i(m)=l 

f» e e n « 

aeV2(m) t(l),i(2),...i(m) (r,s)e<r 
i(l),j(2),...j(m)=l 

1 n m 

E E IP- 



c rpr <j(l) <z( m ) 

»(r)i(s)0»(s)j(r) £j L a j(l)i(2) * " " 



j(ro)i(l)J 



i(r)i(s)0»(s)j(r) £j L a j(l)i( 7 (l)) ■ ■ ■ a j(m)i( 7 (m))J 



,9(1) 



g(m) 



J^#I L 11 fyr)iWr)) E K(lk7(D) ' ' ' a 3(r:)n M„,„J 

<reV 2 {m) i(l),i(2),...i(m) r=l 
i(l),j(2),...j(m)=l 



(4.34) 



(4.35) 



(4.36) 
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1 H 

rrr Y Y E[a 9 !!J Y m , . . . a q( ) m \ .. . J (4.37) 



lim 

aeV 2 (m) j(l),j(2),...j(m)=l 

y lim E(ti a JA^\A ((12 \...,A (qm) )]) . 



n— >oo 

<r£NC2(m) 



Now it follows from Lemma 4.4 that, 



V lim E (tr a JA {qi) , A {q2) , . . . , A {qm) )}) = V lim (Etr) CT7 L4 (gi) , A (q2) , . . . , A M )] 



n— >-oo r * n— >oo 

a£NC2(m) aeNC2(m) 



^[a (qi) ,a^\...,a^)}. 

(reNC2(m) 



This shows l4~25l and hence freeness in the limit. 

The above method can be easily extended to plug in more independent copies of W and 
A. The following details will be necessary. 

(1) The extension of Lemmata 4.3 and 4.4. Note that these extensions can be easily ob- 



tained using the injective mapping ip described in Sections] and used in Theorem 3.1 



(2) When we consider several independent copies of the Wigner matrix the product 
in (4.36) gets replaced by 



IT 

r=l 



i{r)j(a{r))Op( r )p(a{r))- 



Here (p(l),p(2), . . . ,p(m)) denotes the colors corresponding to the independent Wigner 
matrices. The calculations are similar to Theorem 22.35 of Nica and Speicher |27j . 
The rest are some algebraic details, which we skip. □ 



Having proved the Theorem we now come back to the proof of Lemma 4.3 and 4.4 The 
next Lemma turns out to be the most essential ingredient in proving Lemma 4.3 and it points 
out the behavior of a colored pair-matched word which contains a Wigner string inside it. 

Lemma 4.5. For any colored pair-matched word w and a Wigner string wuj\ which is a 
pair-matched word and satisfies equation (4.29) 



p{w) = p{w {iij) )p(w {i>j) c 



(4.38) 



Further, if Wu + x and wu^y satisfy (4.30) then so does w. 

Proof. Given any 7Ti G H*(w( i+ ij-i)) and n 2 G H*(w( it j)c) construct n as: 

7T = (7T 2 (0), . . . 7T 2 (Z-1), 7Ti(0), . . . TTiO-i-1) = ^(0), 7T 2 (z-l), . . . (2fc-j + Z-l)) G U* (i)j) {w). 

Conversely, from any 7r G Ht^Jw) one can construct tti and tt 2 by reversing the above 
construction. 
So we have 

in^Hi = in^+^iin*^,^)!. (4.39) 

Let \wu + i = 2Z X and |ti>(ij)c| = 2l 2 and note that (1 + l\) + (1 + Z 2 ) = k + 1. 

Now using the fact that u>(jj) satisfies (4.29) and dividing equation (4.39) by n k+l we get 
in the limit, 



p(w) =p(w {i+1 j^ 1) )p(w[ iJ) ). 
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Now we claim that 

\ u *( w (i,j))\ = ™|n*0 ( i +1)i _i))|. 

Now given n G U*(w^j)), one can always get a n' G IT(w;( i+ ij_i)), 



(4.40) 

where the Tr(i — 1) is 



arbitrary and hence 



\ n *( w a,j))\ 



< |n*(w( i+ ij_i))|. Also given a 7r' G II* one can 



choose ir(i — 1) in n ways and also assign = n(i — 1) or 7r(i), making j a dependent 
vertex. So we get that, |n*(w (i j))| > n\U*(w^ +ltj -i))\. This shows ( |4.40[ ). So from ( |4.40[ ) it 
follows that 

P( w (i,j)) =P(«'(*+ij-i)) J 
whenever wry) is a Wigner string. 

Also note that from the first construction, 



l n (C2)H 



l n (C2)( W (i+l,j-l)! 



1^(02) ( W (i,i) e 



Now suppose and ty^c satisfy (4.30). So we have that 

llP^i+ij-!))! = infojj^tw^+u-i))! +o(n /l+1 ) and |n*(w (iii)c )| = 

Multiplying these and using the fact (from (4.38)) |n*(w)| = \U*(wu + i t j^y 
o(n fc+1 ), the result follows. 



n(C2) ( W (i,j) c 



n*(w (iJ)c )| - 



□ 



We now give a proof of Lemma 4.3 



Proof of Lemma \4-3[ We use induction on the length I of the Wigner string. Let w be a 
pair-matched colored word of length 2k with p(w) ^ 0. First suppose the Wigner string is 
of length 2, that is, I = 2. We may without loss of generality assume them in the starting 
position. So we for any ir G II* (w) with above property we have 



(7r(0),7r(l)) 



(7T(l),7r(2)) 
(7T(2),7T(1)). 



In the first case 7r(0) = 7r(l) = 7r(2) and so 7r(l) is not generating vertex and this lowers the 
number of generating vertices (which is not possible as p(w) ^ 0). Hence, the only possibility 
is (7r(0), 7r(l)) = (7r(2), 7r(l)) and the circuit is complete for the Wigner string and so it is 
a pair- matched word, proving part (a). Also, as a result of the above arguments only C2 
constraints survive, which shows (b). 

Now suppose the result holds for all Wigner strings of length strictly less than /. Consider 
a Wigner string of length /, say wnn (we assume it to start from the first position). We 
break the proof into two cases I and II. In case I, we suppose that the Wigner string has 



a Wigner string of smaller order and use induction hypothesis and Lemma 4.5 to show the 
result. In Case II, we assume that there is no Wigner string inside. So there is a string of 
letters coming from matrix A after a Wigner letter. We show that this string is pair-matched 
and the last Wigner letter before the Z-th position is essentially at the first position. This 
also implies that the string within a Wigner string do not cross a Wigner letter. 

Case I: Suppose that tf(i,z) contains a Wigner string of length less than / at the position 
(p, q) with 1 < p < q < I. Since W( p , g ) is a Wigner string, by Lemma 4.5 we have, 

p(w) = p(w M )p(w {m) c) ^ 0. 

So by induction hypothesis and the fact that both p(w( P;q )) and p(w( Piq )c) are not equal to 
zero we have, W(p iq ) and W( p , q y are pair-matched words and they also satisfy (4.29). So u>(i,q 
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is a pair-matched word, as it is made up of W( p , g ) and Wfa q y which are pair-matched. Also 
from second part of Lemma 4.5, we have itVin satisfies part (b) and (c). 

Case II: Suppose there is no Wigner string in the first I positions. Consider the last Wigner 
letter in the first / — 1 positions, say at position j . Since there is no Wigner string of smaller 
length, 7r(j ) is a generating vertex. Also, as jo is the last Wigner letter, the positions from 
jo to / — 1 are all letters coming from the matrix A. 

Now we use the structure of the matrix A. 



Subcase II(i) : Suppose A is a Toeplitz matrix. Let s, = (Tr(jo + i) — tt(jo + i 
i = 1, 2, — 1 — jo- Now consider the following equation 



Sx + S 2 . . . + S|_i- 



-Jo 



(7r(/-l)-vr(jo)). 



1)) with 



(4.41) 



If for any j, w[j] is the first appearance of that letter, then consider Sj to be an independent 
variable (can be chosen freely). Then due to the Toeplitz link function, if w[k] = w[j], where 
k > j, then = ±Sj. Since (1,/) is a W match, n(l — 1) is either ir(0) or tt(1) and hence 
7r(/ — 1) is not a generating vertex. Note that (4.41) is a constraint on the independent 
variables unless sj + . . . + sj_i_ JO = 0. If this is non-zero, this non-trivial constraint lowers 
the number of independent variables and hence the limit contribution will be zero, which is 
not possible as p(w) ^ 0. So we must have, 



tt(Z - 1) = vr(jo) 



and 



Jo 



1. 



This also shows (tt(1),tt(1 — 1)) = (7r(0), 7r(l)) and hence wnn is a colored word. As S\ + 
. . . + S£_!_j = 0, all the independent variables occur twice with different signs in the left 
side, since otherwise it would again mean a non-trivial relation among them and thus would 
lower the order. Hence we conclude that the Toeplitz letters inside the first I positions are 
also pair-matched. Since the CI constraint is satisfied at the position (1,1), part (6) also 
holds. 



Subcase II(ii) : Suppose A is a Hankel matrix. We write, ti 
and consider 



(7rO"o + i)+7rO'o + i-l)) 



h - U 



\ f ' : h , i = (-l)'-*- 1 ^ - 1) - ttOo)). 



(4.42) 



Now again as earlier, the ij's are independent variables, and so this implies that again to 



avoid a non-trivial constraint which would lower the order, both sides of the equation(4.42) 
have to vanish, which automatically leads to the conclusion that 7r(Z — 1) = 7r(jo) — ^(l)- So 
jo = 1 and again the Wigner paired string of length I is pair-matched. Part (6) also follows 
as the C2 constraint holds. 

Subcase Il(iii): A is Symmetric or Reverse Circulant. Note that they have link functions 
which are quite similar to Toeplitz and Hankel respectively, the proofs are very similar to 
the above two cases and hence we skip them. □ 



Proof of Lemma \4.4\ We first show that, 



E 



n 



tr 



xi 



n 



kt/2 



-E 



tr 



xb 1 



n 



0(— ) as n — > oo, 
n 



(4.43) 
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where tr denotes the normalized trace. To prove ( 4.43[ ), we see that 



E 



i 



n 

i=l 



tr 



Ti- 



ki 1 2 



E 



tr 



X„ 



n 



ki/2 



1 



n 



(4.44) 



1^ E E[ ( n(^-E(X„)))]. 

7ri,7r2 r .7Tj j=l 

If the circuit 7Tj is not jointly matched with the other circuits then EX X . = and 

i 

E[(II(^ - EPQ))] = E^CIJ^ - E(X W< )))] = 0. 

If any of the circuits is self matched i.e. it has no cross matched edge then 
i 

E[(n(**« - E (^)))] = - E(^J] E[(JI(^ - E(XJ))] = 0. 

Now total number of circuits {tti, 7T2, . . . 7r;} where each edge appears at least twice and one 
edge at least thrice is < Cn^ i = lki ^ 2+l ~ 1 , by Property B. Hence using Assumption (A2) such 



terms in (4.44) are of the order O(^). Now consider rest of terms where all the edges appear 

exactly twice. As a consequence Yl\=i ^» i s even - Also number of partitions of \ Yl\=\ ^ 
into I circuits is independent of n. We need to consider only {tti, 7T2, ■ ■ ■ tti} which are jointly 
matched but not self matched. 

If we prove that for such a partition the number of circuits is less than Cn^^ 1 we 



are done since the number of such partitions is independent of n and (4.3). 

Since 7i"i is not self matched we can without loss of generality assume that the edge value for 
(7r(0), 7t(1)) occurs exactly once in 7Tl. So construct iii as follows. First choose 7Ti(0) = 7ii(ki) 
and then choose the remaining vertices in the order iii(ki), 7r 1 (A; 1 — 1) . . . 7i"i(l). One sees that 
we loose one degree of freedom as in this way the edge (vr(0), vr(l)) is determined and we 
cannot choose it arbitrarily. 

The result now follows from (4.43) by using induction. For I = 2 expanding and using the 
fact that expected normalized trace of the powers of X n / \fn converges we get, 

2 



E 



n 



tr 



E 



E 



tr 



tr 



X ki 

_n 

x ki 

n 

n ki/2 ' 
X kl 



n 



fei/2 



tr 



-E 
E 

X k2 
n 

kj2 



tr 



Xt 



n 



ki/2 



tr 



X„ 



ki/2 



n 



tr 



X k2 



iv 



k 2 /2 



E 



tr 



X k2 



n 



k 2 /2 



n 





X kl ~ 




K 2 ' 


-E 


tr ? 


E 




n kl 


n k 2 



— > as n — > oo. 



So the result holds for I = 2. Now suppose it is true for all 2 < m < I. We expand 

lim Ef[l(tr((% fcl ) - E(tr((% fc <)))] = 

to get 



n->oo x /n \/n 

i=l 



I my- y 

i™E(-D"' E E|ntr((^)".)] n E|tr((%")]=0. 

m=l ix<i2...<im i=l V i({h,i2,— im} 
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Now using the result for products of smaller order successively, 



lim(-l) , E[ntr((%^)]= lim^(-ir £ E[f[tr((%^)] II E ( tr ((% 

i=l m<£ i\<i%... <i m 3=1 i£{ii,i2,—im} 

Now every term in right side is by induction hypothesis lim n _ s>00 Y[ i= i E[tr((^=)**)] and from 
this the Lemma follows. □ 



Proof Remark 3.2. We just briefly sketch the arguments as the proof is quite similar to the 



previous section but much easier. Note that if W is centered GUE with variance 1/n then, 

E[WyW w ] = \s jk . (4.45) 



This equation (4.45) provides the CI constraint in the proof of Theorem 3.4 So following 



the steps in the proof of Theorem 3.4 we have 



lim — - E[Tr (WA qW WA q( - 2) . . . WA q(m) )] 



1 n 

= n^Lri^ H II hr)3(s)5i(s)j(r) Htf% (2 ) " ■ ■ Q S(1)1 

(reV2(m) i(l),i(2),...i(m) (r,s)e<J 
j(l),j(2),...j(m)=l 



V lim E (ti a JA iqi) , A {q2 \ . . . , A {qm) )]) 



n— >oo 
o-£NC2(m) 



Now the result follows by applying Lemma 4.4 which holds under Property B and existence 



of LSD. □ 

Acknowledgement 

The authors thank Wlodek Bryc, Alice Guionnet, Koushik Saha and Roland Speicher for 
helpful comments and for providing some important references. They are also grateful to 
the Referee for his/her comments which have led to a much better presentation. 

References 

[1] G. Anderson, A. Guionnet, and O. Zeitouni. An introduction to random matrices. 

Cambridge University Press, 2010. 
[2] Bai, Z. D. and Silverstein, J. Spectral Analysis of Large Dimensional Random Matrices. 

Science Press, Beijing, 2006. 
[3] S. Banerjee and A. Bose. Noncrossing partitions, Catalan words and the semicircular 



law. To appear in J. Theoret. Probab., 2011. URL http : //dx . doi . org/10 . 1007/ 



|sl0959-011-0365-4| 

[4] F. Benaych-Georges, A. Guionnet, and M. Maida. Fluctuations of the extreme eigen- 
values of finite rank deformations of random matrices. Electron. J. Probab., 16:no. 
60, 1621-1662, 2011. ISSN 1083-64 89. doi: 10.1214/EJP.vl6-929. URL |http : | 
|//dx . doi . org/10 . 1214/EJP . v!6-929| 

[5] P. Biane. On the free convolution with a semi-circular distribution. Indiana Univ. Math. 
J., 46:. 3, 705-718, 1997. 



JOINT CONVERGENCE 



29 



A. Bose and A. Sen. Another look at the moment method for large dimensional random 
matrices. Electron. J. Probab., 13:no. 21, 588-628, 2008. ISSN 1083-6489. 
A. Bose and S. Sen. Finite diagonal random matrices. To appear in J. Theoret. Probab., 
2011. URL |http : //dx . doi . org/10 . 1007/sl0959-011-0378-z| 

A. Bose, R. S. Hazra, and K. Saha. Convergence of joint moments for independent 



random patterned matrices. Ann. Probab., Vol. 39, No. 4, 1607-1620, 2011. URL http 
|//dx . doi . org/10 . 1214/10-A0P5971 
A. Bose, R. S. Hazra, and K. Saha. Half independence and half cumulants. Elect. 
Comm. Probab., Vol. 16, 405-422, 2011. 

W. Bryc, A. Dembo, and T. Jiang. Spectral measure of large random Hankel, Markov 
and Toeplitz matrices. Ann. Probab., 34(l):l-38, 2006. ISSN 0091-1798. doi: 10.1214/ 
009117905000000495. URL |http : //dx . doi . org/10 . 1214/009117905000000495] 
M. Capitaine, C. Donati-Martin, and D. Feral. The largest eigenvalues of finite rank 
deformation of large Wigner matrices: convergence and nonuniversality of the fluctua- 
tions. Ann. Probab., 37(l):l-47, 2009. ISSN 0091-1798. doi: 10.1214/08- AOP394. URL 
|http : //dx . doi . org/10 . 1214/08-A0P394[ 

M. Capitaine, C. Donati-Martin, D. Feral, and M. Fevrier. Free convolution with a 
semicircular distribution and eigenvalues of spiked deformations of Wigner matrices. 
Electron. J. Pr obab., 16:no. 64, 1750-1792, 2011. ISSN 108 3-6489. doi: 10.1214/EJP. 
vl6-934. URL |http : //dx . doi . org/10 . 1214/EJP . v!6-934l 

M. Capitaine and M. Casalis. Asymptotic freeness by generalized moments for Gaussian 
and Wishart matrices. Application to beta random matrices. Indiana Univ. Math. J., 



53(2):397-431, 2004. ISSN 0022-2518. doi: 10.1512/iumj. 2004.53.2325. URL ptp: 
|//dx . doi . org/10 . 1512/iumj . 2004 . 53 . 2325| 

M. Capitaine and C. Donati-Martin. Strong asymptotic freeness for Wigner and Wishart 
matrices. Indiana Univ. Math. J., 56(2): 767-803, 2007. ISSN 0022-2518. do i: 10.1512/ 
iumj. 2007.56.2886. URL |http : //dx . doi . org/10 . 1512/iumj . 2007 . 56 . 2886 



B. Collins. Moments and cumulants of polynomial random variables on unitary groups, 
the Itzykson-Zuber integral, and free probability. Int. Math. Res. Not., (17):953-982, 
2003. ISSN 1073-7928. doi: 1 0.1155/S107379280320917X. URL |http : //dx . doi . org?] 
|10. 1155/S10737 92803 20917XI 

B. Collins and P. Sniady. Integration with respect to the Haar measure on uni- 
tary, orthogonal and symplectic group. Comm. Math. Phys., 264(3):773-795, 2006. 
ISSN 0010-3616. doi: 10. 1007/s00220-006- 1554-3. URL |http : //dx . doi . org/10 . 1007/| 
|s00220-006-1554-3| 

B. Collins, A. Guionnet, and E. Maurel-Segala. Asymptotics of unitary and orthogonal 
matrix integrals. Adv. Math., 222(1):172-215, 2009. ISSN 0001-8708. doi : 10.1016/j. 
aim.2009.03.019. URL |http : //dx . doi . org/10 . 1016/ j . aim. 2009 . 03 . 019| 
R. Couillet and M. Debbah and J. Silverstein. A deterministic equivalent for the analysis 
of correlated MIMO multiple access channels. IEEE Trans. Inform. Theory 57, no. 6, 
34933514, 2011. 

K. Dykema. On certain free product factors via an extended matrix model. J. Fund. 
Anal, 112(l):31-60, 1993. ISSN 0022-12 36. doi: 10. 1006/jfan. 1993. 1025. URL |http : | 
|//dx . doi . org/10 . 1006/ jf an . 1993 . 1025| 

D. Feral and S. Peche. The largest eigenvalue of rank one deformation of large Wigner 
matrices. Comm. Math. Phys., 272(1): 185-228, 2007. ISSN 0010-3616. doi: 10.1007/ 



30 R. BASU, A.BOSE, S. GANGULY, AND R. S. HAZRA 



s00220-007-0209-3. URL |http : //dx . doi . org/10 . 1007/s00220-007-0209-3 



[21] W. Fulton. Eigenvalues of sums of Hermitian matrices (after A. Klyachko). Asterisque, 
(252):Exp. No. 845, 5, 255-269, 1998. ISSN 0303-1179. Seminaire Bourbaki. Vol. 
1997/98. 

[22] C. Hammond and S. J. Miller. Distribution of eigenvalues for the ensemble of real sym- 
metric Toeplitz matrices. J. Theo ret. Probab., 18(3):537-566, 2005. ISSN 089 4-984 0. doi: 
10.1007/sl0959-005-3518-5. URL |http : //dx . doi . org/10 . 1007/sl0959-005-3518-5[ 

[23] F. Hiai and D. Petz. Asymptotic freeness almost everywhere for random matrices. Acta 
Sci. Math. (Szeged), 66(3-4) :809-834, 2000. ISSN 0001-6969. 

[24] F. Hiai and D. Petz. The semicircle law, free random variables and entropy, volume 77 
of Mathematical Surveys and Monographs. American Mathematical Society, Providence, 
RI, 2000. ISBN 0-8218-2081-8. 

[25] C. Male. The norm of polynomials in large random and deterministic matrices. To 
appear in Prob. Theory Related Fields. 2012. 

[26] M. W. Meckes. On the spectral norm of a random Toeplitz matrix. Electron. Comm. 
Probab., 12:315-325 (electronic), 2007. ISSN 1083-589X. 

[27] A. Nica and R. Speicher. Lectures on the combinatorics of free probability, vol- 
ume 335 of London Mathematical Society Lecture Note Series. Cambridge Univer- 
sity Press, Cambridge, 20 06. ISBN 978-0-521-85852-6; 0-521-85852-6. do i: 10.1017/ 
CBO9780511735127. URL |http : //dx . doi . org/10 . 1017/CBQ9780511735127| 

[28] T. Oraby. The spectral laws of Hermitian block- matrices with large random blocks. 
Electron. Comm. Probab., 12:465-476, 2007. ISSN 1083-589X. 

[29] S. Peche. The largest eigenvalue of small rank perturbations of Hermitian random 
matrices. Probab. Theory Relate d Fields, 134(1):127-173, 2006. ISSN 0178-8051. doi : 
10.1007/s00440-005-0466-z. URL |http : //dx . doi . org/10 . 1007/s00440-005-0466-z| 

[30] L. Pastur and V. Vasilchuk. On the law of addition of random matrices. Comm. 
Math. Phys., 214(2) :249-286, 2000. ISSN 0010-3 616. doi: 10.1007/s002200000264. URL 
|http : //dx . doi . org/10 . 1007/s00220000"0264l 

[31] R. Rashidi Far, T. Oraby, W. Bryc, and R. Speicher. On slow-fading MIMO systems 
with nonseparable correlation. IEEE Trans. Inform. Theory, 54(2):544-553, 2008. ISSN 
0018-9448. 

[32] 0. Ryan. On the limit distributions of random matrices with independent or free en- 
tries. Comm. Math. Phys., 193(3) :595-626, 1998. ISSN 0010-3616 . doi: 10.1007/ 
S002200050340. URL http : //dx . doi . org/10 . 1007/s002200050340] 

[33] 0. Ryan and M. Debbah. Asymptotic behavior of random Vandermonde matrices with 
entries on the unit circle. IEEE Trans. Inform. Theory, 55(7):3115-3147, 2009. ISSN 
0018-9448. doi: 10.1109/TIT.2009.2021317. URL |http : //dx . doi .org/10 . 1 109/fTTT] 
12009.20213171 

[34] H. Schultz. Non-commutative polynomials of independent Gaussian random matrices. 
The real and symplectic cases. Probab. Theory Related Fields, 131(2):261-309, 2005. 
ISSN 0178-8051. doi: 10.1007/s00440-004-0366-7. URL |http : //dx . doi . org/10 . 1007/| 
|s00440-004-0366 r 7| 

[35] R. Speicher. Free convolution and the random sum of matrices. Publ. Res. Inst. Math. 
Sci, 29(5):731-744, 1993. ISSN 0034-5318. doi: 10.2977/prims/1195166573. URL 



http : //dx . doi . org/10 . 2977/prims/l 195166573 



JOINT CONVERGENCE 



31 



[36] R. Speicher On universal products. Fields Institute Communications, Vol. 12, AMS, 
pp. 257-266,1997. 

[37] R. Speicher. Free probability theory. To appear in Handbook on Random Matrix Theory, 
2010. 

[38] A. M. Tulino and S. Verdu. Random matrices and wireless communications, volume 
vol. 1 of Fundations and Trends in Communications and Information Theory. Now 
Publishers Inc., 2004. 

[39] D. Voiculescu. Addition of certain noncommuting random variables. J. Fund. Anal. 



66(3):323-346, 1986. ISSN 0022-1236. doi: 10.1016/0022-1236(86)90062-5. URL|httpj 
|//dx . doi . org/10 . 1016/0022- 1236 (86) 90062-5| 
[40] D. Voiculescu. Limit laws for random matrices and free products. Invent. Math., 104 



(l):201-220, 1991. ISSN 0020-9910. doi: 10.1007/BF01245072. URL |http://dx.doi, 
|org/10 . 1007/BF01245072[ 
[41] D. Voiculescu. A strengthened asymptotic freeness result for random matrices with 
applications to free entropy. Internat. Math. Res. Notices, (l):41-63, 1998. ISSN 
1073-7928. doi: 10.1155/S107379289800004X. URL |http : //dx . doi . org/10 . 1155/| 
IS107379289800004X1 

[42] E. P. Wigner (1958). On the distribution of the roots of certain symmetric matrices. 
Ann. of Math., (2), 67, 325-327. 

Department of Statistics University of California, Berkeley 
E-mail address: riddhipratim@stat.berkeley.edu 

Statistics and Mathematics Unit, Indian Statistical Institute, 203 B.T. Road, Kolkata 
700108, India 

E-mail address: bosearu@gmail.com 

Department of Mathematics, University of Washington, Seattle 
E-mail address: sganguly@math . Washington . edu 

Institut fur Mathematik, Universitat Zurich, Winterthurerstrasse 190, CH-8057, Zurich 
E-mail address: rajatmaths@gmail.com 



